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Abstract 

In a stochastic probing problem we are given a universe E, where each element e € E is 
active independently with probability p e £ [0,1], and only a probe of e can tell us whether it 
is active or not. On this universe we execute a process that one by one probes elements — 
if a probed element is active, then we have to include it in the solution, which we gradually 
construct. Throughout the process we need to obey inner constraints on the set of elements 
taken into the solution, and outer constraints on the set of all probed elements. The objective 
is to maximize a function of successfully probed elements. 

This abstract model was presented by Gupta and Nagarajan (IPCOT3), and provides 
a unified view of a number of problems. Adamczyk, Sviridenko, Ward (STACS’14) gave 
better approximation for matroid environments and linear objectives. At the same time 
this method was easily extendable to settings, where the objective function was monotone 
submodular. However, the case of non-negative submodular function could not be handled 
by previous techniques. 

In this paper we address this problem, and our results are twofold. First, we adapt 
the notion of contention resolution schemes of Chekuri, Vondrak, Zenklusen (SICOMP’14) 
to show that we can optimize non-negative submodular functions in this setting with a 
constant factor loss with respect to the deterministic setting. Second, we show a new con¬ 
tention resolution scheme for transversal matroids, which yields better approximations in the 
stochastic probing setting than the previously known tools. The rounding procedure under¬ 
lying the scheme can be of independent interest - Bansal, Gupta, Li, Mestre, Nagarajan, 
Rudra (Algorithmica’12) gave two seemingly different algorithms for stochastic matching 
and stochastic fc-set packing problems with two different analyses, but we show that our 
single technique can be used to analyze both their algorithms. 
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1 Introduction 

Stochastic variants of optimization problems were considered already in 1950 Emm, but only 
in recent years a significant attention was brought to approximation algorithms for stochastic 
variants of combinatorial problems. In this paper we consider adaptive stochastic optimization 
problems in the framework of Dean et al. |12| who presented a stochastic knapsack problem. 
Since the work of Dean et al. a number of problems in this framework were introduced Emm 
m m [sum n]. Gupta and Nagarajan [120] presented an abstract framework for a subclass 
of adaptive stochastic problems giving a unified view for stochastic matching |9] and sequential 
posted pricing [7]. Adamczyk et al. [T] generalized the framework by also considering monotone 
submodular functions in the objective. In this paper we generalize the framework even further 
by showing that also maximizing a non-negative submodular function can be considered in the 
probing model. On the way we develop a randomized procedure for transversal matroids which 
can be used to improve approximation for the k- set packing problem [3]. 

Below paper enhances the iterative randomized rounding for points from matroid polytopes 
that was presented in [1]. The analysis from [T] does not easily carry over when the objective 
submodular function is non-monotone. To handle non-monotone objectives we are making use 
of contention resolution schemes introduced by Chekuri et al. [8]. Contention resolution schemes 
in the context of stochastic probing already were used by Gupta and Nagarajan [20] . Recently, 
Feldman et al. m presented online version of contention resolution schemes which, on top of 
applications for online settings, yield good approximations for stochastic probing problem for 
a broader set of constraints than before — most notably, for inner knapsack constraints and 
deadlines. 

Our paper fills the gaps between and merges results from basically four different paper [U 
0 m in]. That is the reason why this paper comes with diverse contributions: we improve 
the bound on measured greedy algorithm of Feldman et al. m; adjust contention resolution 
schemes to stochastic probing setting in a way in which submodular optimization is be possible; 
use iterative randomized rounding technique to develop contention resolution schemes; moreover, 
we revisit the algorithms of Bansal et al. [3]. 

Below we present the necessary background. 

The probing model 

We describe the framework following [20]. We are given a universe E, where each element e £ E 
is active with probability p e £ [0,1] independently. The only way to find out if an element 
is active, is to probe it. We call a probe successful if an element turns out to be active. On 
universe E we execute an algorithm that probes the elements one-by-one. If an element is active, 
the algorithm is forced to add it to the current solution. In this way, the algorithm gradually 
constructs a solution consisting of active elements. 

Here, we consider the case in which we are given constraints on both the elements probed and 
the elements included in the solution. Formally, suppose that we are given two independence 
systems of downward-closed sets: an outer independence system ( E,Z out ) restricting the set 
of elements probed by the algorithm, and an inner independence system (F?,Z m ), restricting 
the set of elements taken by the algorithm. We denote by Q * the set of elements probed in the 
first t steps of the algorithm, and by S' 4 the subset of active elements from Q t . Then, S* is the 
partial solution constructed by the first t steps of the algorithm. We require that at each time 
t, Q t £ X out and S t £ T in . Thus, at each time t, the element e that we probe must satisfy both 
Q t_1 U {e} £ Z out and S l ~ l U {e} £ Z m . The goal is to maximize expected value E [f (S)] where 
/ : 2 e —>• M>o and S is the set of all successfully probed elements. 

We shall denote such a stochastic probing problem by ( y E,p 1 I m 1 I out ^ with function / stated 
on the side, if needed. 
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Submodular Optimization 


A set function / : 2 E H > M>o is submodular, if for any two subsets S, T C E we have f (S U T) + 
f (S nT) < f ( S ) + / (T). Without loss of generality, we assume also that / (0) = 0. 

The multilinear extension F : [0,1]^ '—>• M>q of /, whose value at a point y € [0,1]^ is given 


by 


F{ y )= E/w-n^nc 1 -*)- 

ACE eCA e^A 


Note that F (1a) = / (A) for any set A C E, so F is an extension of / from discrete domain 2 E 
into a real domain [0, 1\ E . The value F(y) can be interpreted as the expected value of / on a 
random subset A C E that is constructed by taking each element e € E with probability y e . 


Contention Resolution Schemes 

Consider a ground set of elements E and an down-closed family X C 2 E of X”s subsets — we 
call ( E,T ) an independence system. Let V (X) be the convex hull of characteristic vectors of sets 
from X. Given x € V (X) we define R (x) to be a random set in which every element e £ E is 
included in R (x) with probability x e ; set R (x) defined like that is used frequently throughout 
the paper. 

Chekuri et al. [8] presented a framework of contention resolution schemes (CR schemes) that 
allows to maximize non-negative submodular functions for various constraints. The following 
definition and theorem come from |8j. 

Definition 1 

Let (E,Z) be independence system. For b,c € [0,1], a (b, c)-balanced CR scheme n for V (X) is a 
randomized procedure that for every x E b ■ V (X) and A C E, returns a random set n x (A) such 
that: 

1. always n x (A) C A fi supp (x) and tt x (A) € X, 

2. P [e € tt x (Ai)] > P [e € e x (A2)] whenever e E Ai C A 2 , 

3. for all e € supp (x), P [e € tt x (R (x))| e£li (x)] > c. 

Theorem 1 

Let (E,Z) be an independence system. Let f : 2 E -A- M be a non-negative submodular function 
with multilinear relaxation F, and x be a point inb-V (X). Let n be a (b, c)-balanced CR scheme 
for V (Z), and let S = ir x (R (x)). If f is monotone then E [/ (S')] > c ■ F (x). Furthermore, 
there is a function rjf : 2 E -A- 2 E that depends on f and can be evaluated in linear time, such 
that even for f non-monotone E [/ ( r/f (S))] > c ■ F (x). 

Function iy (S) represents a pruning operation that removes from S some elements. To 
prune a set S with pruning function r/f, an arbitrary ordering of the elements of E is fixed: for 
simplicity of notation let E = {1,..., | E\} which gives a natural ordering. Starting with S prun = 0 
the final set S prun = r/f (S) is constructed by going through all elements of E in the given order. 
When considering an element e, S prun is replaced by S prun + e if / (S p ™ n + e) — / (S p ™ n ) > 0. 

Note that a pruning operation like that is not possible to execute in the probing model since 
we commit to elements. We address this issue in Section [2] where we show how to perform 
on-the-fly pruning. 


Stochastic fc-set packing 

We are given n elements/columns, where each element e € [n] has a random profit v e € M+, and 
a random d-dimensional size S e € {0, l} d . The sizes are independent for different elements, but 
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v e can be correlated with S e , and the coordinates of S e also might be correlated between each 
other. Additionally, for each element e, there is a set C e C [d] of at most k coordinates such that 
each size vector S e takes positive values only in these coordinates, i.e., S e C C e with probability 

1. We are also given a capacity vector b E Z+ into which elements must be packed. We say that 
column S e outcomes are monotone if for any possible realizations a, 6 € {0, l} d of S e , we have 
a < b or b < a coordinate-wise. A strategy probes columns one by one, obeying the packing 
constraints, and its goal is to maximize the expected outcome of taken columns. Bansal et al. [3] 
gave a 2fc-approximation algorithm for the problem, and a (k + 1 ^approximation algorithm 
when they assume that the outcomes of size vectors S e are monotone. The technique from [T] 
allows to get a (k + l)-approximation for the problem without the assumption of monotone 
column outcomes. 


1.1 Our contributions at a high level 

There are two main contributions of the paper. First is Theorem [2] which implies that non¬ 
negative submodular optimization in the probing model is possible if we are given CR schemes. 
Our second contribution is the improved insight for transversal matroids in the context of 
stochastic probing, captured in Theorem 0] and new analyses of algorithms from [3j for stochas¬ 
tic k -set packing and stochastic matching. It is based on the iterative randomized rounding 
technique of |T|. 


1.1.1 Non-negative submodular optimization via CR schemes in the probing model 

To obtain our results we extend the framework of CR schemes into the probing model, and we 
define a stochastic contention resolution scheme (stoch-CR scheme). Define a polytope 


V (l u \l out ) = jx 


x € V ( Z out ) ,p-x£V (Z in ) 



By act (S) we denote the subset of active elements of set S. Note that event e E act(R(x )) 
means both that e E R(x) and that e is active; this event has probability p e x e . 


Definition 2 

Let (E,p,I m ,I out ) be a stochastic probing problem. For b,c E [0,1], a (b, c)-balanced stoch-CR 
scheme 7r for a polytope V is a probing strategy that for every x E b-V (Z in ,Z out \ and 

A C E, obeys outer constraints T out , and the returned random set tt x (A) satisfies the following: 

1. it x ( A ) consists only of active elements, 

2. it x ( A ) C An supp (x) and Z x (A) E T m , 

3. P [e E 7f X {R (x)) | e E act (R (x))] > c, 

4- P [e E It x (Ai)] > P [e E tt x (A 2 )] whenever e E Ai C A 2 . 

In Section [2] we present a mathematical program that models our problem. Solving the 
program, getting x + , and running the stoch-CR scheme tt x + on R (x + ) constitute the algorithm 
from the below Theorem. 


Theorem 2 

Consider a stochastic probing problem [E,p,I m ,T out '), where we need to maximize a non¬ 
negative submodular function f : 2 E i->- M>o- If there exists a (b,c)-balanced stoch-CR scheme 
it for V (X m ,I out ), then there exists a probing strategy whose expected outcome is at least 
c [b • e~ b — o(l)) • E [/ (OPT)]. 
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To put this Theorem into perspective. 


There exists a 


b, 


1—e 


-balanced scheme for 


intersection of k matroids [8], and there exists a (6, (1 — 6) fc )-balanced ordered scheme for in¬ 
tersection of k matroids mm- For example when k m = k out = 1, Lemma flOl and the above 
Theorem, after plugging appropriate number 6, yield approximation of 0.13. See Section [5] for 
discussion on other types of constraints. 


1.1.2 Optimization for transversal matroids 

Stochastic probing on intersection of transversal matroids We improve upon the ap¬ 
proximation described in the previous Section, if we assume the constraints are intersections of 
transversal matroids. We do it by developing a new stoch-CR scheme. This scheme is direct in 
the sense that we do not construct it by applying first a scheme for outer and then for inner 
constraints, as in Lemma M 


Lemma 3 

There exists a ^6, -balanced stoch-CR scheme when constraints are intersections 

of k tn inner and k out outer transversal matroids. 

For k in = k out = 1 the above Lemma together with Theorem [2] give approximation factor 
of 0.15, so a modest improvement over 0.13, but it gets significantly better for larger values of 
k in + k out . With k = k in + k out we plug b = ^- i+ 2 1 ^. +1 and we use Theorem [2] to conclude the 
following Theorem. 


Theorem 4 

For maximizing non-negative submodular function in the probing model with k m inner and k out 
outer transversal matroids there exists an algorithm with approximation ratio of 


k + \jk+\ + \ 

There are further applications of the techniques used in Lemma [3j 



Regular CR scheme for transversal matroids When k m = 0 this scheme yields ^6, 
balanced CR scheme for deterministic setting. So far only a (6, (1 — b) -balanced ordered 
scheme and a ^6, ((l — e b ) -balanced scheme were known |8]; see section [2] for the defi¬ 
nition of ordered scheme. Our scheme can be seen as an improvement when one looks at the 
max;, (6 • c) — first one yields e ^ + ^ , second (for k bigj), and we get 

Stochastic fc-set packing and stochastic matching Here we want to argue that the 
martingale-based analysis of the algorithm for transversal matroids can be of independent inter¬ 
est. In the bipartite stochastic matching problem [5] the inner constraints define bipartite match¬ 
ings and outer constraints define general 6-matchings — both are intersections of 2 transversal 
matroids. Stochastic k- set packing problem does not belong to our framework, but we have 
already defined it in previous subsection. 

Bansal et al. [1] presented an algorithm for the fc-set packing, and have proven that it yields 
a (k + 1 ^approximation but when assuming that the column outcomes are monotone. They also 
presented a 3-approximation algorithm for the stochastic matching problem. Both algorithms 
first choose a subset of elements: for k- set packing the elements are chosen independently, 
and for stochastic matching the elements are chosen using a dependent rounding procedure of 


1 The precise value is smaller than jrrj starting k > 4. 
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Gandhi et al. m- After that they probe elements in a random order. Bansal et al. [1] gave 
two quite different analyses of the two algorithms, while we show how both algorithms can be 
analyzed using our martingale-based technique for transversal matroids. First, we show that 
their algorithm for set packing is in fact a (k + l)-approximation even without the monotonicity 
assumption (see Appendix [F]). Second, we also show that the our technique of analysis provides 
a proof of 3-approximation of their algorithm for stochastic matching (see Appendix iGl). 


2 Optimization via stoch-CR schemes 

Mathematical program 

Another extension of / studied in [6] is given by: 


f + (y) = max 


Y a Af(A) 

ACE 


Y OLA < 1, VjCE Y, aA — yp ^ACE OLA > 0 
ACE A-.jcA 


Intuitively, the solution (a a) ace above represents the distribution over 2 E that maximizes the 
value E [/(A)] subject to the constraint that its marginal values satisfy P [i E A] < y j. The 
value f + (y) is then the expected value of E [f (A)] under this distribution, while the value 
of F (y) is the value of E [/ (A)] under the particular distribution that places each element 
i in A independently. This relaxation is important for our applications because the following 
mathematical programming relaxation gives an upper bound on the expected value of the optimal 
feasible strategy for the related stochastic probing problem: 


maximize {/ + (x ■ p) \x € V (X m ,X oni ) } . 


(1) 


Lemma 5 

Let OPT be the optimal feasible strategy for the stochastic probing problem in our general setting, 
then E [f (OPT)} < /+ (®+ • p). 

Proof of the following Lemma can be found in |f], and for sake of completeness we put it in 
the Appendix O 

However, the framework of Chekuri et al. |5] uses multilinear relaxation F and not /+. The 
Lemma below allows us to make a connection. Note that F(x) is exactly equal to E [F(R (®))], 
i.e., it corresponds to sampling each point e € E independently with probability x e , while 
definition of f + (x ) involves the best possible, most likely correlated, distribution of E's subsets. 
It follows immediately that for any point x we have f + (x) > F(x), and therefore the following 
Lemma states a stronger lower-bound for the measured greedy algorithm of Feldman et al. [13]. 
Details are presented in the next paragraph. 

Lemma 6 

Let b E [0,1], let f be a submodular function with multilinear extension F, and letV be any down¬ 
ward closed polytope. Then, the solution x E [0, 1} E produced by the measured greedy algorithm 
satisfies 1) x E b ■ V, 2) F (x) > (b ■ e~ b — o (1)) • max^g-p f + (y). 

Stronger bound for measured continuous greedy 

We now briefly review the measured continuous greedy algorithm of Feldman et al. [15] , The 
algorithm runs for (W 1 discrete time steps, where <5 is a suitably chosen, small constant. Let 
y ( t) be the algorithm’s current fractional solution at time t. At time t, the algorithm selects 
vector I (t) E V given by arg max x &V YsecE x e ■ (•F ( y ( t) V l {e |) - F(y (t))) (where V denotes 
element-wise maximum). Then, it sets y e (t + 5) = y e ( t) + 5I e (t ) • (1 — y e (t )) and continues to 
time t + 5. 
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The analysis of Feldman et al. shows that if, at every time step 

F(y(t + 6)) - F(y(t)) > 5 • [cT* • f (OPT) - F (y(t ))] - O (nH 2 f (OPT)) , (2) 

then we must have F (y(T)) > [ Te~ T — o(l)] • f(OPT). We note that, in fact, this portion of 
their analysis works even if f(OPT) is replaced by any constant value. Thus, in order to prove 
our claim, it suffices to derive an analogue of (|2J) in which f(OPT) is replaced by f + (x + ), where 
x + = argmax^ g -p/ + (y). The remainder of the proof then follows as in |13| . 

Lemma [7] below contains the required analogue of Q. Hence it implies Lemma [6J Proof of 
below Lemma is placed in the Appendix lAl 

Lemma 7 

For every time 0 < t < T 

F (y(t + S))-F (y(t)) > 6 ■ [e^ ■ f + (x + ) - F(y(t ))] - 0(nH 2 ) • /+ (x+) . 

Using stoch-CR schemes 

The following Lemma is implied by TheoremQ] - it follows just from the fact that set act (R (x)) 
is distributed exactly as R (x ■ p). 

Lemma 8 

Let (E,p,I in ,I out ) be a probing problem. Let f : 2 E i->- M> 0 be a non-negative submodular 
function with multilinear relaxation F , and x be a point in b -V (l in . I out ) for b G [0,1]. Let it x 
be a (b,c)-balanced stoch-CR scheme for V (l ir \F ouf ). Let ft x (R(x)) be the output of the CR 
scheme, and let pp (tt x (R(x))) be a pruned subset of n x (R(x)). It holds that 

E [/ (Vf (TTx (R 0 * 0 )))] >c-F(x-p). 

However, we cannot apply yet the above Lemma to reason about a probing strategy, because 
here the pruning pj of S is done after the process. In the probing model we commit to an 
element once we successfully probe it, and therefore we cannot do the pruning operation after 
the execution of a stoch-CR scheme. However, since a probing strategy inherently includes 
elements one-by-one, we can naturally add to any stoch-CR scheme the pruning operation done 
on the fly. The idea is to simulate the probes of elements that would be rejected by the pruning 
criterion. To simulate a probe of e means not to probe e and to toss a coin with probability 
p e — in case of success to behave afterwards as if e was indeed taken into the solution, and 
in case of failure to behave as if e was not taken. During the execution of a stoch-CR scheme 
tt x we construct two sets: S prun consists of elements successfully probed, and S mrt consists of 
elements whose simulation was successful. If in a step we want to probe an element e such that 
/ ( S prun + S mrt + e) — / (S prun + S mrt ) < 0, then we simulate the probe of e and if successful 
S mrt •(— S mrt + e; otherwise we really probe e and S prun S prun + e if successful. We can 
see that at any step, it holds that S prun = pf (S prun + S mrt ). Also, the final random set 
S p run _|_ gmrt j g distributed exactly as n x (R (x)). Hence, the outcome of such a probing strategy 
is E [/ ( S prun )] = E [/ (p f ( S prun + S™ rt ))] = E [/ (p f (tt x (R (x))))] > c ■ F (x ■ p) , where the 
inequality comes from Lemma [8] Thus we have proven what follows. 

Lemma 9 

Let f ,x,tt x be as in Lemma 0 There exists a probing strategy whose expected outcome is 
E [/ (Vf (Tr (R (s))))] > c ■ F (x ■ p). 

Now we can finish the proof of Theorem [2j Consider the following algorithm. First, use 
Lemma [6] to find a point x* such that 

F (x* ■ p) > (b ■ e~ b — o (1)') • max f + (x ■ p). 

V / xeV(i in ,i oui ) 
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Second, run the probing strategy based on a stoch-CR scheme ir x * as described in Lemma El 
This yields, together with Lemma 0 that the outcome of such a probing strategy is 

(yj {n x * (R(x*))))\> c-F (x* ■ p) > c-(b-e~ b - o( 1)) • max f + (x-p) 

> c- [b-e~ b -o( 1)) ■ E [/ (OPT)]. 

In |8j also an alternative approach than pruning was used. They defined a strict contention 
resolution scheme where the approximation guarantee P [e € ir x (R ( x )) |e € R (x)] > c holds with 
equality rather than inequality. Since the pruning operation depends on an objective function, 
resigning from it allows for the algorithm to be used in maximizing many submodular functions 
at the same time. In our stochastic setting we can also skip the pruning operation if we have a 
strict scheme. No proof of this fact is needed, since we can directly use an appropriate analog 
of Lemma [8] (Theorem 4.1 from [I]). 

Stochastic probing for various constraints 

Gupta and Nagarajan [20] introduced a notion of ordered CR scheme , for which there exists 
a (possibly random) permutation a of E, so that for each A the set n x (A) is the maximal 
independent subset of I obtained by considering elements in the order of a. Ordered scheme 
are required to implement probing strategies, because of the commitment to the elements. CR 
schemes exist for various types of constraints, e.g., matroids, sparse packing integer programs, 
constant number of knapsacks, unsplittable flow on trees (UFP), fc-systems (including intersec¬ 
tion of k matroids, and Ai-matchoids). Ordered schemes exist for k-systems and UFP on trees. 
See Theorem 4 in [20] for a listing with exact parameters. 

The following Lemma is based on Lemma 1.6 from [8]. The proof basically carries over, the 
only thing we have to do is to again incorporate probes’ simulations as in the proof of Lemma [9j 
Proof of Lemma nni is placed in Appendix [C] Theorem 3.4 from [[20] yields a similar result but 
would imply a ( b,c ou t + Ci n — l)-balanced stoch-CR scheme. Thus the below Lemma can be 
considered as a strengthening of Theorem 3.4 from [20], because an FKG inequality is used in 
the proof instead of a union-bound. 

Lemma 10 

Consider a probing problem. ( y E,p,Z m ,Z out '). Suppose we have a (6, c ou t)-balanced CR-scheme 
ir out forV (Z out ), and a (6, Cj n )-balanced ordered CR scheme n in forV ( Z in ). Then there exists 
a (b,c ou t ■ Ci n )-balanced stoch-CR scheme forV (Z in ,Z out ^j. 

In light of the above Lemma, one can question Definition [2] of a stoch CR-scheme — why do 
we need to define it at all, if we can just be using two separate classic CR schemes n out , n 171 . The 
reason is that there may exist stoch-CR schemes that are not convolutions of two deterministic 
schemes, and that yield better approximations than corresponding convoluted ones. Such a 
stoch-CR scheme is presented in Section [3] 

In a recent paper, Feldman et al. m presented a variant of online contention resolution 
schemes. They enriched the set of constraints possible to use in the stochastic probing problem 
— previously inner knapsack constraints were not possible to incorporate, as well as deadlines 
(element e can be taken only first d e steps) for weighted settings. Their results can be extended 
to monotone submodular settings by making use of a stronger bound for continuous greedy 
algorithm [6] presented in [1] . The stronger bound for measured greedy algorithm — which works 
for non-monotone functions — that we give in this paper can also be used in m enhancing 
their result by the possibility of handling non-monotone functions as well. 
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3 Stoch-CR scheme for intersection of transversal matroids 

In this section we prove Lemma [3l We assume we have only one inner matroid to keep the 
presentation simple. Also, we shall present a (l, ^-balanced CR scheme, instead of (^b, • 

In the Appendix [El we present a full scheme with arbitrary b,k m , and k out . 

Our stoch-CR scheme on the input is given a point x such that p ■ x € V (Al m ) and a set 
A C E, and on the output it returns set tt x (A). The procedure is divided in two phases. First, 
the preprocessing phase, depends only on the point x. Second, the random selection phase, 
depends on the set A C E and the outcome of the preprocessing phase. 

Matroid properties 

Let A4 in = ( E,Z m ). We know [2TJ that the convex hull of { 1^4 \A € X}, i.e., characteris¬ 
tic vectors of all independent sets of _M m , is equivalent to the matroid polytope V (_A/P n ) = 

{x E M> 0 A&z in YleeAPe ' x e — r M in (^) }> where r M in is the rank function of _M m . Thus for 
any x € V (_A/f m ) in polynomial time we can find representation p ■ x = Pi • 1^, where 

B i,..., B m E X and f3 1 ,..., /3 m are non-negative weights such that YPliLi Pi = 1 • We shall call 
sets B i,..., B rn the support of p ■ x in A4 m , and denote it by B. 

In the remainder of the section we assume that we know the graph representation (E U V,V E X V) 
of the matroid described below. This assumption is quite natural and common, e.g., [3]. 

Definition 3 

Consider bipartite graph (E U V, C E X V). Let X be a family of all subsets S of E such that 
there exists a matching between S and V of size exactly |S|. Then M = (E,I) is a m.atroid, 
called transversal matroid. 


Preprocessing 

In what follows we shall write superscripts indicating the time in which we are in the process. 

We start by finding the support £>° of vector p ■ x € V (Ai m ), i.e., p ■ x = Hi Pi’ 1 B ( f For 
every two sets B,A E £>° we find a mapping 4>°[B, A] :B^AU {X}, which we call transversal 
mapping. This mapping will satisfy three properties. 


Property 1 

For each a E A there is at most one b E B for which <jP[B, A] ( b ) = a. 

Property 2 

For b E B\ A, if (jP[B, A] (b) = L, then A + b E X, otherwise A — (fP[B, A] (6) + b E X. 


Note that unlike in standard exchange properties of matroids, we do not require that 
cf>° [_B,A] (6) = b, if b E A n B. Property 3 will be presented in a moment. Once we find the 
family (fp of transversal mappings, for each element e E E we choose one set among B® : e E Bf 
with probability Pi/p e x e \ since Pi = Pe x e this is properly defined. Denote by c(e) 

the index of the chosen set, and call e-critical the set B for any t (note that c(e) is fixed 

For each 


throughout the process). We concisely denote indices of critical sets by C = (c(e)) egE 


element e we define T 0 (e) = | / / / e A ^ 


B°, ~,B°, , 

c{f) ’ c(e) 


(/) = e| — the blocking set of e. 


The 


Lemma below follows from Property 1, and its proof is in the Appendix [UJ 


Lemma 11 

If p ■ x E V (A4 m ), then for any element e, it holds that 


:,R(x) \ Yj 




< 1, where the expectation is over R (x) and the choice of 


critical sets C; here x [£] is a, 0-1 indicator of random event £. 
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Algorithm 1 Stoch-CR scheme ir x (A) 


find support B° of p ■ x in Ai tn and family fP\ choose critical sets C 
remove from A all e : x e = 0; mark all e € A as available 
5^—0 

while there are still available elements in A do 
pick element e uniformly at random from A 
if e is available then 
probe e 

if probe of e successful then 
S' •(— S' U {e} 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 


for each set Bj of support B do 
Bj *— B\ + e 
call e unavailable 
else simulate the probe of e 
if probe or simulation was successful then 
for each set Bj of support B t do 


/ 


B t , 

c(e)’ c(/) 


(e) 


if / / e then 5* (/) 
compute the family 


Bjff^ — f and call / unavailable 


for each i do B 
t i — / i 1 I 

return S as n x (A) 


t +1 


Bj 


Random selection procedure 

The whole stoch-CR scheme is presented in AlgorithmQ] During the algorithm we modify sets 
of support B l after each step, but we keep the weights /3i unchanged. We preserve an invariant 
that each Bj from B l is an independent set of matroid AA in . At the end of the algorithm the set 
tt x (A) belongs to every set Bj E B t . Hence, the final set n x (A) is independent in every matroid. 

Now we define Property 3 of transversal mappings. Suppose that in the first step we update 
the support £>° according to the for loop in line [15l and we obtain B 1 . Different support B 1 
requires a different family of mappings q A, and so in step 2, the elements that can block e are 
r 1 (e). If it happens that T 1 (e) p T° (e), then we cannot show the monotonicity property of 
stoch-CR scheme. However, we can require from the transversal mappings to keep the blocking 
sets T* (e) unchanged, as long as e is available. In the Appendix [B] we show how to find such a 
family of transversal mappings (fP and how to construct (j) t+1 given (jp. 

Property 3 

Let cj) 1 be a family of transversal mappings for B t . Suppose we update the support B l and obtain 
B t+1 . Then we can find a family f t+1 of transversal mappings such that T 4 (e) = r i+1 (e) for 
any element e that is still available after step t. 

Analysis 

First, an explanation. We allow to pick in line [5] elements that we have once probed and simulate 
their probe. This guarantees that the probability that an available element is blocked is equal 
for every step. Otherwise, again, we would not be able to guarantee the monotonicity. 

In the analysis we deploy martingale theory. In particular Doob’s Stopping Theorem which 
states that if a martingale and stopping time r are both “well-behaving”, then E [ Z T ] = 

E [Z°]. In the Appendix[D]we put necessary definitions, statement of Doob’s Stopping Theorem, 
and an explanation of why we can use this Theorem. 
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The random process executed in the while loop depends on the critical sets chosen in the 
preprocessing phase. Therefore, when we analyze the random process we condition on the choice 
of critical sets C. 

We say e is available, if it is still possible to probe, i.e., it is not yet blocked, and it was not 
yet probed. Define X e = [e € A]; in Iverson notation |/aZse] =0 = 1— [[trite]. 

Let Yf for t = 0,1,..., be a random variable indicating if e is still available after step t. 
Initially Yf = X e . Let P* be a random variable indicating if e was probed in one of steps 
0,1,..., or t: we have P® = 0 for all e. Variable P^ +1 — P* indicates if e was probed at step t+ 1. 
Given the information P 1 about the process up to step t, the probability of this event is 

E[P t e +1 -P t e \P t ,C]=^, 

because if element e is still available after step t (i.e., Y* = 1), then with probability pjj we 
choose it in line [5j and otherwise (i.e. Y* = 0) we cannot probe it. 

Variable Y* — Yf +l indicates whether element e stopped being available at step t+ 1, i.e., we 
either have picked it in line [o] and probed (with probability or some / € T* (e) has blocked 

-yt _^ 

e in line [TT] (with probability • E/er*(e) Pf X f)- So in total 


E [Y* -Y* +1 \P t ,C] = 



1 + Pf x f 
/£ r*(e) 


and we can say that 


E 


{Pe +1 -Pe) 


1+ S P f X f 

/6 r*(e) 


- - Y e +1 ) 


P,C 


= 0 . 


This means that the sequence ^1 + E/er 4 (e) Pf x fJ ' P\ + is a martingale. Let 

r = minjt | Yf = 0 } be the step in which edge e became unavailable. It is clear that r is a 
stopping time (definition in Appendix iDl) . Thus from Doob’s Stopping Theorem we get that 


E t 

(l+ Y, Pf X f\- P e+K T 

c 

= E 

(i+ E Pt x t)p+ Y ° 

C 


. \ /£ r’-(e) J 



. \ /ero(e) J 



and this is equal to X e , because P® = 0 and Y e ° = X e . We have Y e T = 0, and expression 
1 + J2fer r (e) PfXf is in fact equal to 1 + E/er°(e) Pf X f (Property 3 of the transversal mapping, 
as e was available before step r), which depends solely on C and A. Hence 


i+ £ Pf x f -E r [p;|c] = v e . 

/er<>(e) J 

Now just note that E r [P£\ C\ is exactly the probability that e is probed, so we conclude that 

F[ee7r x (A)\C]=p e -K T [Pj\C}=p e X e jl 1+ ^ p f X f j. 

/ \ /er°(A) J 


Monotonicity Set T 0 (e) does not depend on A, but only on the vector p ■ x and C, so for 
Ai C A 2 we have T,fero(A)Pf ' If G ^il < E/ e rQ(A)P/ ' If € ^l- 
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Approximation guarantee In the identity 


P[e E 7 t x {A)\C\ =p e X e 


+ Y Pf x i 

/ero (A) 


we place random set R (x) instead of A; now Xj = x [f £ R (x)] is a random variable. Let us 
condition on e E R (x), take expected value [-| e E R (x)], and apply Jensen’s inequality 

to convex function x ha L to get: 


P [e E 7 r x (.R (x))| e E R (x)] = E C i?(x ) [P [e E tt x (R (x))| C, R (x)]| e E R (x)] 


PeX e / 

(i+ £ PfX f \ 

e € R (x) 

/ 

\ /er°(e) / 



> Pe 



1+ Y p f X f 

e € R (x) 

/6 r°(e) 





Since E C , R ( X ) [Ef£r°(e)Pf x f 


e € R (x) 


< 1 from Lemma EH we conclude that 


P [e E 7 t x (R (x))| e E R (x)] > y, 

and therefore P [e E tt x (R (x))| e E act (R (x))] > which is exactly Property 3 from the deh- 
nition of stoch-CR scheme. 
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A Stronger bound for measured continuous greedy 

Recall, we need to prove Lemma [7] To do so, we shall require the following additional facts from 
the analysis of [15]. 


Lemma 12 (Lemma 3.3 in [15] 1 

Consider two vectors x,x' € [0, 1\ E , such that for every e € E, \x e — x' e \ < 6. Then, F(x') — 
F(x) > £ eeE (x' - x e ) ■ d e F(x ) - O (n 3 <5 2 ) • f (OPT). 

Lemma 13 (Lemma 3.5 in [13] ) 

Consider a vector x € [0,1] E . Assuming x e < a for every e € E, then for every set SUE, 
F(xVl s )> (l-a)f(S). 

Lemma 14 (Lemma 3.6 in [13]) 

For every time 0 < t < T and element e € E, y e (t) < 1 — (1 — 5) t / s < 1 — exp (— t) + O (6). 


Lemma 0 For every time 0 < t < T: 

F ( y(t + 5)) - F (y(t )) > 6 • [e _t • f + (x + ) - F(y(t))] - 0(n 3 6 2 ) ■ /+ (x+). 

Proof. Applying Lemma fl2l to the solutions y(t + 5) and y(t), we have 

F(y(t + S)) - F(y(t)) 

> J2 S ■ Ie (t) (1 - y(t)) • djF(y(t)) - O (n 3 d 2 )) • f(OPT) (3) 

eCE 

=y, s ■ h(t )a - v(t)) • F (^)vb) -ni/(b) _. f{OPT) 

eg E y ^ ’ 

= Y J S-h(t)- [.F(y(t) V 1,) - F(y(t))} - 0(n 3 5 2 ) • f(OPT) 

eCE 

>^5-xt [F(y(t ) V 1,) - F(y(t))} - 0(n 3 5 2 ) ■ f(OPT) (4) 

eCE 

where the last inequality follows from our choice of I(t). 

Moreover, we have f + (x + ) = YIace °a/(A) for some set of values ola satisfying YIace a A = 
1 allcl Y.ACE-A*=A a A ~ A Tllus > 

E < w) v w - r(vm = EE [ F (w(‘) vij)- F(ym 

eg E ACE jcA 

> E“ a [ f fe( f ) v U) - F(„m > E <*A [(e-‘ - 0(5)) ■ f(A) - F(y(t))] 

ACE ACE 

= (e- t -0(6))-f + (x + )-F(y(t)). 

where the first inequality follows from the fact that F is concave in all positive directions, 
and the second from Lemmas ED and [TH Combining this with the inequality (|4|), and not¬ 
ing that f + (x + ) > f + (OPT) = f (OPT), we finally obtain F(y(t + <5)) — F(y(t )) > 5 ■ 
[ e -t . /+( x +) - F(y(t))\ - 0(n 3 d 2 ) ■ f+(x+). □ 

B Transversal mappings 


Recall the definition of a transversal matroid. 
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Definition 4 

Consider a bipartite graph (E U V, C E X V). Let X be a family of all subsets S of E such that 
there exists an injection from S to V. Then M = (. E,T ) is a matroid, called transversal matroid. 

We assume we know the graph {E U V, C E X V) of the matroid. 

Let B° be the initial support. Let A E B° be an independent set. From the definition of the 
transversal matroid, there exists an injection v A : A —>• V; we shall say that a E A is matched 
to v A (a). There can be many such injections for a given set, but we initially pick one for every 
A E B°. When a set of the support will be changed we shall explicitly define an injection. In 
fact, only for added elements we will define a new match, for all other elements they will be 
matched all the time to the same vertex, as long as they are available. 

For any two A, B £ B 8 we define the mapping <fP[B,A\ : B —>• A U {_L} as follows. Let 
v A be the injection of A, and let v B be the injection of B. If there exists element a such that 
v A (a) = v B ( b ), then we set 4>°[B,A] ( 6 ) = a; if not, we set f°[B,A] ( b ) =_L. 

Let us verify that such a definition satisfies first two properties. 

Property 1. For each a E A there is at most one b E B for which (jP[B, A] ( b ) = a. 

This one is trivially satisfied because there can be at most one b E B that according to v B 
is matched to v A (a). □ 

Property 2. For b E B\A, if<jP[B, A] ( b ) = _L, then A+b € T, otherwise A—4>°[B, A] (b)+b E X. 

Suppose (fP[B, A] ( 6 ) = X. It means that b is matched to v B (b) to which no element a E A is 
matched to. Therefore when we add edge (b,v B ( b )) to the injection {(a, v A (&))} ag \ it is still 
a proper injection, since b A, and so A + b E X. Now suppose 4>°[B, A] ( 6 ) = a' Now the 
set A changes to A — a! + b and the underlying injection is {( a,v A ( a ))} (ie ^\ a / U {( 6 , v B ( 6 ))}, 
which is a valid injection since b A, and if so, then A — a' + b is indeed an independent set. 
So Property 2 also holds. □ 

Now let us move to the most technically demanding property. 

Property 3. Let (jf be a family of transversal mappings for B 1 . Suppose we update the support 
B 1 and obtain B t+1 . Then we can find a family (j) t+l of transversal mappings such that T* (a) = 
r t+1 (a) for any element a that is still available after step t. 

Suppose that in step t we have chosen element c, and we update the support B t as described 
in the for loop of the algorithm in line [T21 First of all assume that c/a, otherwise a becomes 
unavailable so there is nothing to prove. Let C t be the critical set of c and let v c± (c) be the 
vertex to which c is matched according to v c . Consider set B t E B 1 and let us describe how c 
affects B t+l and injection v B * +1 . 

Case 1, c E B t : If it is c from B l that is matched to v ct (c), i.e., v Bt (c) = v c ' (c), then we do 
not have to change anything, we set B t+l := B 1 and v B±+1 = v Bt . If v B± (c) 7 ^ v ct (c), then let 
b\ be such that v B (b\) = v c (c). We remove b\ from B t , i.e., B t+l := B t \b\ (we do not have 
to add c to B t+1 because it is already there). For every 63 E B t+l we set v Bt+1 ( 63 ) = v B * ( 63 ). 
See Figure [0 
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Case 2, c 
add c instead, 
v B * +1 ( 63 ) = v B 


^ B t : Let b\ be such that v B * (fei) = v c * (c). We remove b\ from B l and 
i.e., B t+l = B* — b\ + c. The injection is defined as: v B±+1 (c) = v C ' (c), and 
t ( 63 ) for 63 € B t \b\. See Figure [2j 



v Bt+ \c) 


„B t+1 


(fc) 




(h) 


Figure 2: Illustration of Case 2, c ^ B t 
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Given sets A t+1 ,B t+1 with corresponding injections ir A<+1 ,v B * +1 we define 
before, i.e., (j) t+1 [B t+1 , A t+l ] ( b) = a, if v At+1 (a) = v B±+1 ( b). 


mapping <f t+1 as 


Now we need to show that the set r 4+1 (a) = | b b a A f 
(a) = 1 6 b / a A (j) 


B t+ 1 B t+1 

c(6) ’ c(a) 


( 6 ) = a | is equal to 


5 4 ,B\ , 

c(b) > c(a) 


(b) = a if a is still available. 

Consider again sets A t+l ,B t+1 and suppose that A 4 is the critical set of a and that B t 
is the critical set of b. Suppose that both a, b are matched to v a b = v A± (a) = v Bt ( b ), i.e., 
b E r* (a). If it happened that in step t element c removed a and b, i.e., v c (c) = v a b, then 
elements a, b are blocked and not available, so there is nothing to prove here. If v c (c) 7 ^ v, 
then from the reasoning in Case 1 and 2 , we know that a and b are still matched to v a b, i.e., 




v a b = (a) = v B ( b ). But if so, then (j) t+1 [B t+ 1 ,yl t+1 ] (6) = a, and b € r* +1 (a) still, 

because A t+1 ,B t+1 remain critical sets of a, b. Conversely, if b is not matched to v A * (a), i.e., 


yB ( 6 ) ^ v A (a), then b ^ (a). But if c during the update does not block b, then b does not 

change its matched vertex so we still have v B * +1 ( b ) 7 ^ v At+1 (o), and still b ^ r <+1 (o). 

Illustration is given in Figure [3l □ 




Figure 3: Illustration of change in T. We have blocked b \, and if b\ € T^ai), then it does 
not matter anyway, because we have also blocked a\. Element c was matched (w.r.t. Bt) to 
the same vertex as 02 , but Bt is not the critical set of c, so c ^ r^c^). Assume B* is a 
critical set of 63 : we have A 4 ]( 63 ) = 03 and so 63 € T 4 (a 3 ); after the update we still have 

(j) t+1 [B t+1 , A t+1 ](bs) = as, so 63 € r 4 + 1 (a 3 ). Element <24 did not have any element b' € B 4 in 
r 4 (a 4 ), so it does not have any b' G _B 4+1 in r <+ 1 (a 4 ) as well. 


C Omitted proofs 

Lemma O Let OPT be the optimal feasible strategy for the stochastic probing problem in our 
general setting, then E [/ {OPT)] < f + ( x + ■ p). 


Proof. We construct a feasible solution x of the following program 

{f+(x-p)\x-pe n %v {Mf) , x g n^> {M° ut ) } , 


maximize 


by setting x e = P [OPT probes e]. First, we show that this is indeed a feasible solution. Since 
OPT is a feasible strategy, the set of elements Q probed by any execution of OPT is always an 
independent set of each outer matroid _A/f °“ 4 = (^E, , he. Q € H*U T. c f ut . Thus the vector 
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and so x € V 


E [1q] = x may be represented as a convex combination of vectors from | 1a A £ Hj =\ T™ lt 

for any j £ {l,..., k out }. Analogously, the set of elements S that 

were successfully probed by OPT satisfy S £ (|y=i lj n f° r ever y possible execution of OPT. 
Hence, the vector E [lg] = x ■ p may be represented as a convex combination of vectors from 

| 1a A £ f]j = iTj n | and so x ■ p £ V (M l Yj for any j £ {l ,... ,k m j. The value f + (x ■ p) 
gives the maximum value of E,gv~x> [/(S’)] over all distributions V satisfying [e £ S'] < x e p e . 

The solution S returned by OPT satisfies P [e € S] = P [OPT probes e]p e = x e p e . Thus, OPT 
defines one such distribution, and so we have E [f(OPT)\ < f + (x ■ p) < f + (x + ■ p). □ 


Lemma II1L If p ■ x £ V then for any element e, it holds that 


E, 


•C,R(x) 


'Yhf^v°(e)Pf ‘ X [f R( x )] E 1> where the expectation is over R(x) and the choice of 


critical sets C; here x [£] is a 0-1 indicator of random event 8. 


Proof. In what follows let us skip writing 0 in the superscript of bases Bf, mappings <fP , 
and set T° (e). 

Let us condition for now on the critical set B c ( e ) of element e. For / to belong to T (e) it 
has to be the case that p [B c ^p -^c(e)] (/) = e - Therefore 


Y Pr xif ^ R{x)\ 

fe r(e) 


Y Pf-x[f £ R&)]- 

f£E\{e} 


( 

'Y X [Bi is /-critical] 

yi:</>[-B;,-B c(e) ](/)=e 


and by changing the order of summation it is equal to 


E E p f ■ x [f € R (x)] • x [Bi is /-critical] . 

i /eB i W[B i ,Bc (e )](/)=e 


Consider / such that / £ Bi \ e : p [Bi, H c ( e )] (/) = e. 
critical set of /) are independent, and E [x[f £ R (x)]] 
P [* = c(/)| B c{e) \ = we get that 


Since x [/ € R (x)] and c (/) (the index 
= Xf and P [Bi is /-critical| L> c (e)] = 


E 


Pf • X [/ £ R (x)] • X Bj is /-critical 


B. 


c(e) 


= PfXf 


Pi 


Pf x f 


= Pi, 


and hence 


E 

Y p f ' A [/ e R{x )] 

-^c(e) 

= E E % 

< E$ = 1 


,/e r(e) 


1 /eB i \e:0[B i) B c(e) ](/)=e 

i 


where the inequality follows from the fact that for each Bi there can be at most one element 
/ £ Bi such that p [Bi,B c ( e ^ (/) = e. □ 


Lemma 1101 Consider a probing problem [E,p,I in ,T out '). Suppose we have a (b,c ou t)-balanced 
CR-scheme ir out forV ( l out ), and a (6, Cj n ) -balanced ordered CR scheme ir in forV (Z m ). Then 
there exists a ( b,c ou t ■ Ci n )-balanced stoch-CR scheme for V (l in ,I out ). 


Proof. First let us recall a Lemma from [8]. 

Lemma [1.6 from [8]] Let T = ("/■ I, and Vx = a tv Suppose each Vx, has a monotone 
(b, a)-balanced CR schem.e. Then Vx has a m.onotone (b,T\-a)-balanced CR scheme defined as 
tt x (A) = a K(A) for AC N,x £ bV x . 
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Suppose we have a CR scheme TT out for V(T out ) and an ordered CR scheme 7r m for V(T ln ). 
We would like to define the stochastic contention resolution scheme for V (l m ,I out '\ just as in 
the Lemma above, i.e., as ir x (A) = n° ut (A) D n™ x (act (A)). However, we cannot just simply run 
7 v° ut on A, and then 7r p n x on A again, and take the intersection, because that does not constitute 
a feasible probing strategy. Once again, we need to make use of simulated probes to get a 
stoch-CR scheme that will have a probability distribution of n° ut (A) 0 tt™ x .(act (A)). How to 
implement such a strategy? We first run n° ut (A) on the set A. Later we use ir™ x to scan elements 
of A in the order given from the definition of an ordered scheme. If considers element e such 
that e G A \ n °“*(A), then we simulate the probe of e; if the e G tt ° ut (A), then we just probe it. 
Therefore, the CR-scheme 7 t™ x works in fact on the set act (ir° ut (A) + (A \ 7r ° ut (A)) mrt ') , where 
(A\ir° ut (A)) mrt represents simulated probes of elements in A\n x ut (A). Assuming e G 7r° Mt (A), 
it is easy to see that elements in act (A) and elements in act (tt x ut (A) + (A \ n° ut (A)) mrt ) have 
the same probability distribution. Therefore, 


F [e € 7r*? x (aci (A))] = 

F [ e £ 7Tp n 3 ,(act (n x ut (A) U (A \ 7r° ut (A)) virts )) \ Tr° ut (A),e G n° ut (A)^ . (5) 

And the RHS corresponds to a second phase of a feasible probing strategy. Thus we have: 


P[e G tt x (A)] 

= P [e G tC*(A) n tt-(tt^(A) U (A \ tt™* (A)) virt )] 


= E„ 


X [e € K ut (A)] ■ E^ [ X [e G n™(act (tt^ (A) U (A \ tt^A))**))] \ n° ut (A),e G Tr° ut (A)] 


Now just note that 


E„» [ x [e 6 tt” «“'(A) U (A \ irT\A)y irt )} |<“‘(.4), e 6 <”*(A)] = 

P [e e < (act (^‘(A) u (A \ n™‘(A)r*))j n™‘(A ),e € n™\A)} = 

P [e e n" x (act (A))] , (6) 

from line (|5|) , and so we can simplify the previous expression to 

P [e G 7 r x (A)] = E^gut [x [e G tt x U \ a )\ • F [e G ir l p n x (act (A))]] 

= Kout [x [e G 7t“*(A)]] • P [e G TT l p n x {act (A))] 

= P [e G TT° ut (A)\ • P [e G TT^ x (act (A))] . 

Now the analysis just follows the lines of Lemma 1.6 from [8j. We plug R(x) for A, and apply 
expectation on R{x) conditioned on e G R(x) to get: 

PP [e € 7 r x (R (x))] |e G R (x)] = E fl(ie) [P [e G 7 r° ut (R (x))] • P [e G n™(act (R (x)))] |e G R (x)] . 

From the fact that both iT out , ir vn are monotone, and act (R (x)) is an increasing function of 
R (x) we get that P [e G ir° ut (R (x))] and also P [e G TT™ x (act (R (x)))] are increasing functions 
of R (x). Thus applying FKG inequality gives us that 

k R(x) [ f [e € 7 t x (R (x))] |e G R (x)] 

=E r{x) [P [e G 7 r° ut (R (x))] • P [e G ir%{act (R (x)))] \e G R (x)] 

>E R{x) [P [e G 7 r° ut (R (x))] |e G R (x)] • E* (a:) [P [e G n%(act (R (x)))] |e G R (x)] 

>b ■ c out • E R ( x ) [P [e G 7r ™ x (act (R (x)))] |e G R (x)] . 
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Now applying also expectation on act ( R (x)), we get finally 

^R(x),act(R(x)) [ F [e e vr x(R (x))] |e € R (x)] 

> Cout ■ E R(x),act(R(x )) [P [e € ir™ x (act (R (x)))] \e € R (x)] > p e ■ c out ■ c in . (7) 

Also, directly from equation P [e € 7r x (A)] =P[e€ TT° ut (A)] -P [e € ir l ™ x (act (A))] we get the 
monotonicity of the stoch CR-scheme n x , since both ir° ut and ( act (•)) are monotone. □ 


D Martingale Theory 

Definition 5 

Let (O, P, P) be a probability space, where Q is a sample space, P is a cr-algebra on D, and P is 
a probability measure on (D,P). Sequence {J~t ■ t > 0} is called a filtration if it is an increasing 
family of sub-a-algebras of J~: Pq C p} C ... C P. 

Intuitively speaking, when considering a stochastic process, a -algebra P) represents all infor¬ 
mation available to us right after making step t. In our case cr-algebra Pj contains all information 
about each randomly chosen element to probe, about outcome of each probe, and about each 
support update for every matroid, that happened before or at step t. 

Definition 6 

A process ( Zt) t>0 is called a martingale if for every t > 0 all following conditions hold: 

1. random variable Zt is Tt-measurable, 

2. E [\Z t \] < oo, 

3. E[Z t+1 \R t \ = X t . 

Definition 7 

Random variable r : O H {0,1,...} is called a stopping time if {r = t} £ J~t f or every t > 0. 

Intuitively, r represents a moment when an event happens. We have to be able to say 
whether it happened at step t given only the information from steps 0,1,2,..., t. In our case we 
define r as the moment when element became unavailable, i.e., it was chosen to be probed or it 
was blocked by other elements. It is clear that this is a stopping time according to the above 
definition. 


Theorem 15 (Doob’s Optional-Stopping Theorem) 

Let ( Zt) t>0 be a martingale. Let r be a stopping time such that r has finite expectation, i.e., 
E[r] < oo, and the conditional expectations of the absolute value of the martingale increments 
are bounded, i.e., there exists a constant c such that E[|Zt_|_i — Zf\ | J~t\ < c for all t > 0. If so, 
then E [Z T \ = E [Zq] . 


In our case E [r] < |A|, because we just pick an element at random from A, so the expected 
value of picking e to be probed is exactly | A\, and since it can be earlier blocked by other elements, 

and 


we have E [r] < |A|. Also the martingale we use is (^1 + X]/er t (e)T'/M) ' + T?) 

since Pj: , Yf € {0,1} then it means that for any t we have ^1 + X^/erhe) 


t> o 
Pi + Yf 


< 


|A| + 1, and so E [|Zt+i — Zf \ P t ] < |A| + 1. Therefore, we can use Doob’s Optional-Stopping 
Theorem in our analysis. 
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Algorithm 2 Stoch-CR scheme n x (A) for A4\ n ,A4Y} n inner matroids and A4° ut ,A4™i t 
outer matroids, and x € b ■ V (l m ,l out f. 


1 : //Preprocessing: 

2 : find support of ■ x € V (jWfp'j for each -AdJ 1 ; 

3: find support ^ ou t[j) of \x € V (^A4f‘ ut 'j for each M° ut ; 

4: find family for every AdJ 1 ; find family for every A4° ut ; 

5: choose critical sets Cfj n for each AT 1 - 1 and C° ut for each A4° ut ; 

6 : //Random selection phase: 

7: remove from A all e : x e = 0; mark all e € A as available; S ■(— 0 
8 : while there are still available elements in A do 
9: pick element e uniformly at random from A 

10: if e is available then 

11: probe e 

12: if probe of e successful then 

13: S U{e} 

14: for each matroid A4f n do 

15: for each set Bf of support £>/,., do 

16: Bf <r- Bf + e 

17: call e unavailable 

18: else simulate the probe of e 

19: if probe or simulation was successful then 

20 : for each set Bf of support B f do 


21 : / t -^c*- n (/) 

22 : if / + e then Bf in(f) -e- Bf in(f} - 

23: for each matroid A4° ut do 

24: for each set Bf of support Bf mt ^ do 

25: Bf <s- Bf + e 

26: /<-<£ -B* out(e) ,^ out(/) (e) 

27: if / / e then Bf out ^ 5* out(/) 

28: compute families 

29: f 4— f -p 1 

30: return S as 71^ (A) 


/ and call / unavailable 


/ and call / unavailable 
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E Full proof of Lemma EH 


The full scheme is presented on Figure [2] Let us concisely denote by C all the critical sets 
chosen, i.e., C = [C] n | X [Cp ) . Transversal mappings d>(.M)° are found in exactly 

V ] )je[k in ] V J /je[fc out ] 

the same manner as in the single matroid version. 

There are two main differences with respect to what was presented in the main body. First, 
since p-x E b-V , then \p-x E V , and the support #9^ is found by decomposing 

j;P ■ x. Thus when element / chooses a critical set in matroid AA . 1 - 1 it chooses with probability 

Pf*/(lp fXf ) = b■ ( PfX f ). This results in the following modification in Lemma HT1 The 

proof is completely analogous, so we skip it. 


Lemma 16 

If ^p ■ x E V (^AAJ 1 ^, then for any element e, it holds that 

E C in ^S/Gr° (e)Pf ' X [f € R (x)] < b, where the expectation is over R(x) and the choice 

of critical sets C. 


Now we also need to deal with outer matroids. Again, the proof is completely analogous, so 
we skip it. 


Lemma IT 

If ^x £ V (A4j Ut ), then for any element e, it holds that 


E, 


\nout 


,R(x) 


critical sets C. 


J2fpr° (e) X [/ G R (x)] < b, where the expectation is over R ( x ) and the choice of 

J out[j] ^ ' J 


Second. Let Yf for t = 0,1,..., be a random variable indicating if e is still available after 
step t. Initially Y® = X e . Let P* be a random variable indicating, if e was probed in one 
of steps 0,1,..., or t. In step t + 1 element e can be blocked if, for some j E [k m ], we pick 
element / E (e) and successfully probe it (or successfully simulate), or if we just pick 

element / E F^r., (e), and probe / or simulate its probe, irregardless of the outcome. Let 
(e) = Uje[fc™ 4 ] Kutlj] ( e ) and let F in (e) = Uje[k“] T L[j] ( e ) \ r o«t (e) — this subtraction is 
to not count an element twice, because if element / belongs to both F( r| ^ (e) and (e), 

then just probing / (or simulating its probe) automatically blocks e, irregardless of f’s probe 
(simulation) outcome. Hence, we do cannot account for the excessive PfXf influence of / on e. 
Therefore, the probability that e stops to be available at step t + 1 is equal to 


E [Yl - Y e 


t+i 


yt yt 

p Cl = — + — 
’ 1 \A\ + |A| 


Y, Pf x i + d| - E 

fcrjje) feU out (e) 


X 


/• 


As in the single matroid case, the probability of probing e is just equal to E [Pg +1 ~ \ ^i^\ = 

p|y. Thus the martingale we use now in the analysis is 


(i+ E «*/+ E x i)- p t+ Y i 

\ fe r*je) fer* at (e) ) 

Let r = min |Yf = 0} be the step in which edge e became unavailable. It is clear that r is a 
stopping time. Thus from Doob’s stopping theorem we get that 
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E t 


( 1 + E p/ a 7 + 

E x,\-p; + y; 

C 

. V /erj-„(e) 

f er^ t (e) / 



= E 


1+ E pj- x j+ E x f}- p °+ye 

/e r?„( c ) /£ro„ t (e) 


C 


And as before, since the transversal mappings are controlled per matroid, we have that T* n (e) = 
r °n (e) and T^ (e) = T° out (e) for t < r. Thus 


P [e € 7f x (A) | C\ = p e • E t [Pl\ C] = p e X e / | 1 + ^ PfXf + 5] X f |. (8) 

' \ /er? B (e) /er° ut (e) 

Monotonicity follows as before. The approximation guarantee similarly from Jensen. 

We take random set i? (x) instead of A; now X'f = x[f & R (x)] is a random variable. Let us 

condition on e € R(x ), take expected value E c,R(x) [‘I e € R (x)] on both sides of [HI and apply 

Jensen’s inequality to convex function x H > - to get: 


[e € 7 t x (R(x))\e £ R (x)] = E c ,r(x) [IP [e € 7 v x (R (x))| C, R (x)]| e € R(x)] = 


= E, 


•C,R{x) 


p e X e j (^1 + E/ e r? Ti (e) PfXf + E/ e r° ut (e) x f) e € R ( x ) 

> Pe / Ec.flC*) [ 1 + E /e r° ( e ) PfXf + £ /er o (e) Xf eeR (x) 


Since 

E c,i?o) 

from Lemma m and 

E C,i?(x) 

from Lemma El we conclude that 

E 


E p f X f 

/er°„ b .](e) 


E A / 

/er° outW (e) 


e £ R{x) 


< 6 


e £ R(x) 


< b 


<>R(x) 


< Ec,i?(a:) 


1 + E + E A / 

/er? n (e) /Gr° ut (e) 


e £ R(x) 


»+ E E p/ x /+ E E 


ie[fc-] / G rO j[ . ] (e) 


je[fc out ] 


e £ R (x) 


— 1 + E ^C,R(x) 

je[k in ] 


E 

/er° By] (e) 


e £ R(x) 


+ E E c,i?(x) 

je[fc out ] 


E x f 

ft r l tb] ( e ) 


e £ R(x) 


<l+k in -b + k out ■ b. 
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And therefore 

P [e € 7 t x (R (x))| e € R (x)l > ——- ^—77 - 

L V n - b ^ in + kout ^ + 1 > 

which yields 

P [e € 7 ^ (F (x))| e € act (R (x))l > --— - 

l \ \ - b (j^n + fcout) + ]_> 

which is exactly Property 3 from the definition of stoch-CR scheme. Lemma [3] follows. 


F Stochastic k- set packing 

In this section we are showing a ( k + l)-approximation algorithm for Stochastic k- Set Packing. 

We are given n elements/columns, where each item e € E = [n] has a profit v e € K+, 
and a random d-dimensional size £ e € {0, l} d . The sizes are independent for different items. 
Additionally, for each item e, there is a set C e of at most k coordinates such that each size vector 
S e takes positive values only in these coordinates, i.e., S e C C e with probability 1. We are also 
given a capacity vector b £ into which items must be packed. We assume that v e is a random 
variable that can be correlated with S e . The coordinates of S e also might be correlated between 
each other. 

Important thing to notice is that in this setting, unlike in the previous ones, here when we 
probe an element, there is no success/failure outcome. The size S e of an element e materializes, 
and the reward v e is just drawn. 

Let pi = IE [S e (j)] be the expected size of the j coordinate of column e. The following is an 
LP that models the problem. Here U (c) denotes a uniform matroid of rank c. 

n 

max ^^E[u e ]-a: e (LP-fc-set) 

e=l 

s.t. pi ■ x & V (U ( bj )) Vj £ [d] 

x e € [0,1] Ve € [n] . 


Where, as usual, x e stands for P [OPT probes column e]. We are going to present a probing 
strategy in which for every element e probability that we will probe e will be at least -j^j- From 
this the Theorem will follow. 

The algorithm is presented on Figure [3j 

Constraint for row j is in fact given be a uniform matroid in which we can take at most 
bj elements from subset {e\j 6 CJ C £, Therefore, we can decompose pi ■ x = Yii 
Uniform matroid is a transversal matroid, so we use the transversal mapping (j)® between sets 
E>i’ 0 , also let C = be the vector indicating the critical sets. We define in the same way 

as we did already in Lemma [3l the sets T*- (e) of blocking elements, i.e., 


e = 






As before, let us from now on condition on C. Let us analyze the impact of / € Tj (e) on 
e. Element / € T^ (e) blocks e when / is chosen and Sf (j) = 1. However, right now / can 
belong to T* (e) for many j € C e . Therefore if / is chosen in line [9] of the Algorithm [3] then the 


probability that / blocks e is equal to P Vy/e U(e) (^/ U) = -0 


C 


Let us now repeat the steps of Lemma 1. Let X e = x [e € R (x)]. Let for t = 0,1,..., be 
a random variable indicating if e is still available after step t. Initially Y® = X e . Let P* be a 
random variable indicating, if e was probed in one of steps 0,1,..., or t; we have P® = 0 for all 
e. 
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Algorithm 3 Algorithm for stochastic k -set packing 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


//Preprocessing: 
for each j £ [d] do 

find support B® of p> ■ x in V (U ( bj )) 
family id¬ 
entical sets C = 

//Rounding: 

let A <— R (x); mark all e € A as available; S' •$— 0 
while there are still available elements in A do 
pick element e uniformly at random from A 
if e is available then 
probe e 
S<- S + e 

for each j £ C e such that S e ( j ) = 1 do 
for each set Bj' 1 of support do 
Bj’* < Bj* + e 
call e unavailable 


else simulate the probe of e 

for each j £ C e such that S e ( j ) = 1 (whether we probe or simulate) do 
for each set Bj* of support B J,< do 



if / + e then B 3 J (f) 
compute the family tftA 1 
for each i do Bj ,t+1 4— Bj* 



f and call / unavailable 


t i — t -hi 


return S 
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Variable Pg +1 — Pi indicates if e was probed at step t + 1. Given the information T l about 
the process up to step t, the probability of this event is E [Pg +1 — Pe| because if 

element e is still available after step t (i.e., Yg* = 1), then with probability we choose it in 
line [9l and otherwise (i.e. = 0) we cannot probe it. 

Variable — V e i+1 indicates whether element e stopped being available at step t + 1. For 
this to happen we need to pick / € T*- (0) and the probe (or simulation) of / needs to result in 
a vector Sf such that Sf (j) = 1. However, as already noted, there can be many j for which 
/ € r* (0). Therefore, probability that e stops being available in step t + 1 is equal to 


yt yt 

J- J- O 


E\Yt-Yl + 1 \F t ,C}=rjr + 


\A\ \A\ 


E*/ 

i 


V (S,U) = 1) 


j:/er*(e) 


c 


Here we stress the condition on C because sets T*- are constructed given the choice of critical 
sets. Again we can reason that 



V ( 5 /C?) = l) 

j:/er*(e) 


c 



t> 0 


is a martingale. Let r = min {f \Y* = 0} be the step in which edge e became unavailable. It is 
clear that r is a stopping time. Thus from Doob’s Stopping Theorem we get that 


E r 

1 

1— 1 

M 

* 

'~~h 

V (S/(i) = D 

c 

1 -K+yj 

c 


. V / 

.jVerj(e) 


J 





( 



\ 


E r 


i + E x /- p 

V (S/W) = 1) 

c 

•p“ + v;° 

C 




j:/e rj(e) 


J 



We argue again using the properties of transversal mapping </>*■ that we have TJ (e) = T 1 - (e) for 
each j € C e , since e was available before step r. And if so, then 




f 



\ 



E r 


i+E x /- p 

V (S/ (i) = 1) 

c 


■PI + YJ 

C 



l / 

• •• • • 


J 




and since 
say that 


(i + E/*/-p[Vi •j e rQ(e) (Sf U) = 1) cj) is just a number depending on C, we can 

E T [P T e \C] = X e . 


( 



\ 

i + E x /- p 

V («/ (i) = 1) 

c 


V 7 

r/er«(e) 


/ 


Note that E r [PJ~| C\ = P [e is probed| C], and conclude that 


/ 

( 



\ 

P [e is probed C\= X e J 

i + E*r p 

V (^/0') = 1 ) 

c 


/ 

l / 



/ 
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At this point we reason as follows: 


E x /' p V («/Ci) = i)c 

/ [j-fe r°(e) 

<E X /- E p i s /0) = i ic] 

/ j:/e r°(e) 

=E X /- E 4 

/ j:/e r°(e) 

= E E ^ i x d 

J'eCe /erP(e) 

where inequality just follows simply from the union-bound. Then we have an identity since event 
(5/ (j ) = 1) is independent of C and its probability is just equal to p^. Later we just change the 
order of summation. Therefore we have shown that 


/ 


1 [e is probed| C] > X e 


1 + E E p.} x f I • 

\ ieCe/e rj(e) 

We apply expectation E^ m.,.\ [-| e € i? (x)] to both sides, use Jensen’s inequality to get 


P [e is probed| e € R (x)] > 1 
Now we can say that 


/ 



\ 

1 + E c,R(x) 

E E p} x f 

e £ R (x) 


V 

ieC e / G r 0(e) 


J 


E C,R{x) 

E E p} x f 

e £ R{x) 


jec e fe r“(e) 



E E C,R(D 

j€C e 


E P/ X / 

/G r?(e) 


e £ R(x) 


< E 1 = igi ^ 

j&C e 


where the last inequality E^ S/erQ(e) P > f X f e ^ i? (x) < 1 for each j comes from LemmafITl 
Hence 


1 


P [e is probed| e € R (x)] > --- 

I A 


which gives 


P [e is probed] = P [e € J? (x)] • P [e is probed| e £ R (x)] > 


x e 

1 + k 


as desired. 


G Stochastic Matching and handling negative correlation 

In the Stochastic Matching problem we are given an undirected graph G = (V,E). Each edge 
e £ E is assigned a probability p e £ (0,1] and a weight w e > 0, and each node v £ V is assigned 
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a patience t v E N + . Each time an edge is probed and it turns out to be present with probability 
p e , in which case it is (irrevocably) included in the matching we gradually construct and it gives 
profit w e . Therefore the inner constraints are given by intersection of two partition matroids. 
We can probe at most t u edges that are incident to node u — these are outer constraints which 
also can be described by intersection of two partition matroids. Our goal is to maximize the 
expected weight of the constructed matching. 

Let us consider the bipartite case where V = {A U B) and E C Ax B. In this case Bansal et 
al. g] provided an LP-based 3-approximation. We shall also obtain this approximation factor. 
Here we present a variant of our scheme from Lemma [3] that does not use transversal mappings, 
because in this case they are trivial. Moreover, previously we required the input of the stoch-CR 
scheme to be a set of elements sampled independently, i.e., R ( x ). Now we shall apply the ideas 
from Lemma El but we use it on a set of edges that are negatively correlated. Such a set is 
returned by the algorithm of Gandhi et al. [IS] . Also, since the objective is linear, and not 
submodular, we do not have to take care of the monotonicity of the scheme, and therefore we 
do not draw edges with repetitions. In fact we just scan rounded edges according to a random 
permutation, and therefore the below algorithm is the same that was presented by Bansal et 
al. g], Thus what follows is an alternative analysis of the algorithm from g]. 

Consider the following LP for stochastic matching problem: 


max 


^ W e p e X e 
e 


(9) 

y PeX e < 1 

W E V 

(10) 

e£S(v) 

^ ^ %e — ty 

W E V 

(11) 

e£S(v) 

0<x e <l 

Ve E E. 

(12) 


Suppose that (x e ) e£E is the optimal solution to this LP. We round the solution with dependent 
;t al. m ; we call th 

j. From the definition of dependent rounding we 


rounding of Gandhi et al. [ TS] ; we call the algorithm GKPS. Let ( X e ) be the rounded 

V / e£E 

solution, and denote E = |e € E 
know that: 


x e = l 


1. (Marginal distribution) P 


W = 1 


= x P . 


2. (Degree preservation) For any v E V it holds that 


Et< 

e£S(v) 


y Xe 

e£S(v) 




3. (Negative correlation) For any v E V and any subset S C 5 (v) of edges incident to v it 
holds that: 


V, 


66 ( 0 , 1 } 


P 


A p- = b 

-eeS 


< 


Ifp[ 


Xp = b 


eeS 


Negative correlation property and constraint (11011 imply that 


y p^f 

e E E 

< E 

y p^f 

./65(e) 



./65(e) 


= y pfXf <2- 2 p e x e . 
/65(e) 


E 


(13) 
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Algorithm 4 Algorithm for Stochastic Matching 


{e |^ e = 1}; 


call every e E E 


1: Solve the LP; let x an optimal solution; 

2: let X E {0, T\ E be a solution rounded using GKPS; let E = 
safe 

3: while there are still safe elements in E do 

4: pick element e uniformly at random from safe elements of E 

5: probe e 

6: if probe successful then 

7: S^S U{e} 

8: call every / E E fl 5 (e) blocked 

9: return S 


Given the solution ( X. 


eG E 


we execute the selection algorithm presented on Figured Because 


of the Degree preservation property we will not exceed the patience of any vertex. We say that 
an edge e is safe if no other edge adjacent to e was already successfully probed; otherwise edge 
is blocked. Initially all edges are safe. 

The expected outcome of our algorithm is 


P [e probed] 


■p e -w e = 


£'[■ 


V. = 1 


• p 


e probed| X e = 1 


• Pe ■ w e 


= w e p e x e ■ P e probed| X e = 1 


and we shall show that P e probed| X e = 1 > ^ for any edge e, which will imply 1/3-approximation 
of the algorithm. 

From now let us condition that we know the set of edges E and we know that X e = 1. 

Consider a random variable Yj which indicates if edge e is still in the graph after step t. We 
consider variable Yj for any edge / E E. Initially we have Yj = 1 for any / E E, and Yj = 0 
for f £ E. Let variable Pj denote if edge e was probed in one of steps 0,1, t; we have Pj = 0. 

Let X/ be the number of edges that are left after t steps. Variable P/ +1 — -P/ indicates 
whether edge e was probed in step t + 1. Given the information P 1 about the process up to step 
t, probability of this event is E 


Y 

= i.e., if edge e still exists in the 




P/+ 1 - P/|P ,; ,P ; A e = 1 

graph after step t (i.e. Yf = 1), then the probability is otherwise it is 0. 

Variable Yf — Yf +l indicates whether edge e was blocked from the graph in step t+ 1. Given 

pX probability of this event is E Yf — Yf +1 1 P l ,E,X e = 1 = ■ (Y^f£S(e)Pf^f + ■ 

It is immediate to note that Yj < Xf for any edge /, and that P/ +1 — Pj is always nonneg¬ 
ative. Hence 


E 


>E 


E P^f + 1 • ( P e +1 ~ P e) ~ ( Y e Y e + ') 

KfeS(e) ) 

E Pf Y f + 1 ) • ( pt e +l ~ pt e ) - i Y e - Y e + ') 


r,E,x e = i 


P\E,X e = 1 


= 0 , 


which means that the sequence 


E P/V + 1 ) k-(i-k) 

VS<5(e) 


t> 0 
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is a super-martingale. 

Let r = min jt \ = 0 } be the step in which edge e was either blocked or probed. It is clear 

that r is a stopping time. Thus from Doob’s Stopping Theorem — this time in the variant for 
super-martingales, i.e., if E [ Z t+1 — Z t | J 7 *] > 0 , then E [Z T ] > E [Z°] — we get that 


E t 


yf^S(e) 






p e T -(i-r e T ) 

E,X e = 1 



> E 

f E + 1 1 ■ F ° - - Y °) 

E,X e = 1 


_ \/S(5(e) 




where the expectation above is over the random variable r only. Since P^ = 0 ,Yg = 1 Xe = 0 
the above inequality implies that 


E t 





E,X e = 1 


> 1. 


Since we condition all the time on E and X e = 1 we can write that 


+ 1 ) • Et 

k/e5(e) 


P T e \E,X e = l 


> 1. 


Let us notice that E T 
write that 


Pl\E,X e = 1 


is exactly equal to P 


e probed| E,X e = 1 


> 


e probed| E, X e = 1 
1 


. Thus we can 


S/e<5(e) Pf X f + 1 


Now we can apply to both sides of the above inequality expectation over E but still conditioned 
on X e = 1: 


P 


e probed | X e = 1 


= E, 


e probed| E , X e = 1 


X e = 1 


— e e 


T,feS(e)Pf X f + 1 

and from Jensen’s inequality, and the fact that x i —> ^ is convex, we get that 


= 1 


Ef 


E fme) Pf x f + 1 


= i 


> 


E; 


X e = 1 


From inequality (fl3l) we get E^, J2feS(e)Pf X f + 1 
2 x e p e < 3 and we conclude that 


E f^e)Pf X S + 1 

E/ea(e) Pf x f + 1 


x e = 1 


— e e 


< 3 - 


e probed| X e = 1 


> 














































